Methods, Portable Electronic Devices, Systems and Computer Program Products for Automatically Creating Social Networking Services (SNS)

ABSTRACT

Methods, portable electronic devices, systems and computer program products are provided for automatically creating a social networking service (SNS) session. The methods include generating at and transmitting from a first device a first audio and/or video fingerprint of an audio and/or video event. The first audio and/or video fingerprint has a first predetermined length (T). A second audio and/or video fingerprint is periodically transmitted to a server from the first device. The second audio and/or video fingerprint has a second predetermined length (t), smaller than the first predetermined length (T), and includes data associated with the audio and/or video event that is later in time than data included in the first audio and/or video fingerprint. The first device is joined to an SNS session, automatically created by the server, responsive to receipts at the server, of a third audio and/or video fingerprint having the first predetermined length (T) from a second device that includes a portion of the first audio and/or video fingerprint or the second audio and/or video fingerprint periodically transmitted from the first device.

FIELD OF THE INVENTION

The present invention relates to communications, and, more particularly,to social networking services (SNS) and related methods, devices,systems and computer program products.

BACKGROUND OF THE INVENTION

Recently, social networking services (SNS), for example, online chatrooms, internet forums and bulletin boards, instant messaging and thelike, have become increasingly prevalent. Social networking servicessuch as these enable people having similar interests, for example,sports, music, babies, politics and the like, to rendezvous in virtualcommunities. Typical, a user creates the virtual community, for example,an online chat room or bulletin board, and defines its context, forexample, rock music. Virtual communities may also be set tip to discussongoing events, for example, concerts, television, shows, sportingevents and the like. In particular, a user can set up an online chatroom to discuss an ongoing football game, or create an online forumwhere people can comment on a beauty contest currently being shown ontelevision. Thus, the emergence of virtual communities may allow usersto communicate with others having like interests without leaving thecomfort of their home or office.

SUMMARY OF THE INVENTION

Some embodiments of the present invention provide methods forautomatically creating a social networking service (SNS) sessionincluding generating at and transmitting from a first device a firstaudio and/or video fingerprint of an audio and/or video event. The firstaudio and/or video fingerprint has a first predetermined length (T). Asecond audio and/or video fingerprint is periodically transmitted to aserver from the first device. The second audio and/or video fingerprinthas a second predetermined length (t), smaller than the firstpredetermined length (T), and includes data associated with the audioand/or video event that is later in time than data included in the firstaudio and/or video fingerprint. The first device is joined to an SNSsession, automatically created by the server, responsive to receipt, atthe server, of a third audio and/or video fingerprint having the firstpredetermined length (T) from a second device that includes a portion ofthe first audio and/or video fingerprint or the second audio and/orvideo fingerprint periodically transmitted from the first device.

In further embodiments of the present invention, the second device maybe configured to generate the third audio and/or video fingerprint andperiodically transmit a fourth audio and/or video fingerprint having thesecond predetermined length (t) to the server. The fourth audio and/orvideo fingerprint may include data associated with the audio and/orvideo event that is later in time than data included in the third audioand/or video fingerprint. A fifth audio and/or video fingerprint havingthe first predetermined length (T) may be received at the server from athird device. The third device may be joined to the SNS session if it isdetermined that the fifth audio and/or video fingerprint having thefirst predetermined length (T) from the third device includes the secondaudio and/or video fingerprint, a portion of the third audio and/orvideo fingerprint, or the forth audio and/or video fingerprint.

In still further embodiments of the present invention, an indicationfrom the server may be received at the first device or the second deviceto terminate periodic transmission of the second or fourth audio and/orvideo fingerprint responsive to joining the third device to the SNSsession. In certain embodiments of the present invention, an indicationmay be received from the server at the first device or the second deviceto reinstate periodically transmitting the second or fourth audio and/orvideo fingerprint to the server responsive to termination of the SNSsession at the third device.

In some embodiments of the present invention, the first, second, third,fourth and fifth audio and/or video fingerprints may be compared at theserver using statistical methods to determine if the first, second,third, fourth and/or fifth audio and/or video fingerprints areassociated with a same audio and/or video event. In certain embodimentsof the present invention, comparing may include adapting a comparisonalgorithm to allow for time shifting.

In further embodiments of the present invention, the generated firstaudio and/or video fingerprint may be processed at the first device toprovide an improved first audio and/or video fingerprint of an audioand/or video event having the first predetermined length (T).

In still further embodiments of the present invention, the SNS sessionmay include an online chat session, an online forum, an online bulletinboard or an instant messaging session.

Although some embodiments of the present invention have been discussedabove primarily with respect to method embodiments, device, systems andcomputer program products are also provided.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram illustrating a network including asocial networking services (SNS) server and devices associated therewithaccording to some embodiments of the present invention.

FIG. 2 is a schematic block diagram illustrating a portable electronicdevice and a cellular communication system in accordance with someembodiments of the present invention.

FIG. 3 is a diagram illustrating transmission and receipt of audio/videofingerprints at a server in accordance with some embodiments of thepresent invention.

FIGS. 4 and 5 are flowcharts illustrating methods according to variousembodiments of the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

The present invention will be described more fully hereinafter withreference to the accompanying figures, in which embodiments of theinvention are shown. This invention may, however, be embodied in manyalternate forms and should not be construed as limited to theembodiments set forth herein.

Accordingly, while the invention is susceptible to various modificationsand alternative forms, specific embodiments thereof are shown by way ofexample in the drawings and will herein be described in detail. Itshould be understood, however, that there is no intent to limit theinvention to the particular forms disclosed, but on the contrary, theinvention is to cover all modifications, equivalents, and alternativesfalling within the spirit and scope of the invention as defined by theclaims. Like numbers refer to like elements throughout the descriptionof the figures.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”,“comprising,” “includes” and/or “including” when used in thisspecification, specify the presence of stated features, integers, steps,operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof. Moreover, whenan element is referred to as being “responsive” or “connected” toanother element, it can be directly responsive or connected to the otherelement, or intervening elements may be present. In contrast, when anelement is referred to as being “directly responsive” or “directlyconnected” to another element, there are no intervening elementspresent. As used herein the term “and/or” includes any and allcombinations of one or more of the associated listed items and may beabbreviated as “/”.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this invention belongs. It will befurther understood that terms used herein should be interpreted ashaving a meaning that is consistent with their meaning in the context ofthis specification and the relevant art and will not be interpreted inan idealized or overly formal sense unless expressly so defined herein.

It will be understood that, although the terms first, second, etc. maybe used herein to describe various elements, these elements should notbe limited by these terms. These terms are only used to distinguish oneelement from another. For example, a first element could be termed asecond element, and, similarly, a second element could be termed a firstelement without departing from the teachings of the disclosure. Althoughsome of the diagrams include arrows on communication paths to show aprimary direction of communication, it is to be understood thatcommunication may occur in the opposite direction to the depictedarrows.

Example embodiments are described below with reference to block diagramsand/or flowchart illustrations of methods, devices, systems and/orcomputer program products. It is understood that a block of the blockdiagrams and/or flowchart illustrations, and combinations of blocks inthe block diagrams and/or flowchart illustrations, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, and/or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer and/or other programmable data processingapparatus, create means (functionality) and/or structure forimplementing the functions/acts specified in the block diagrams and/orflowchart block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instructions whichimplement the functions/acts specified in the block diagrams and/orflowchart block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer-implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe block diagrams and/or flowchart block or blocks.

Accordingly, example embodiments may be implemented in hardware and/orin software (including firmware, resident software, micro-code, etc.).Furthermore, example embodiments may take the form of a computer programproduct on a computer-usable or computer-readable storage medium havingcomputer-usable or computer-readable program code embodied in the mediumfor use by or in connection with an instruction execution system. In thecontext of this document, a computer-usable or computer-readable mediummay be any medium that can contain, store, communicate, propagate, ortransport the program for use by or in connection with the instructionexecution system, apparatus, or device.

The computer-usable or computer-readable medium may be, for example butnot limited to, an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system, apparatus, device, or propagationmedium. More specific examples (a non-exhaustive list) of thecomputer-readable medium would include the following: an electricalconnection having one or more wires, a portable computer diskette, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,and a portable compact disc read-only memory (CD-ROM). Note that thecomputer-usable or computer-readable medium could even be paper oranother suitable medium upon which the program is printed, as theprogram can be electronically captured, via, for instance, opticalscanning of the paper or other medium, then compiled, interpreted, orotherwise processed in a suitable manner, if necessary, and then storedin a computer memory.

Computer program code for carrying out operations of data processingsystems discussed herein may be written in a high-level programminglanguage, such as Java, AJAX (Asynchronous JavaScript), C, and/or C++,for development convenience. In addition, computer program code forcarrying out operations of example embodiments may also be written inother programming languages, such as, but not limited to, interpretedlanguages. Some modules or routines may be written in assembly languageor even micro-code to enhance performance and/or memory usage. However,embodiments are not limited to a particular programming language. Itwill be further appreciated that the functionality of any or all of theprogram modules may also be implemented using discrete hardwarecomponents, one or more application specific integrated circuits(ASICs), or a programmed digital signal processor or microcontroller.

It should also be noted that in some alternate implementations, thefunctions/acts noted in the blocks may occur out of the order noted inthe flowcharts. For example, two blocks shown in succession may in factbe executed substantially concurrently or the blocks may sometimes beexecuted in the reverse order, depending upon the functionality/actsinvolved. Moreover, the functionality of a given block of the flowchartsand/or block diagrams may be separated into multiple blocks and/or thefunctionality of two or more blocks of the flowcharts and/or blockdiagrams may be at least partially integrated.

For purposes of illustration and explanation only, various embodimentsof the present invention are described herein in the context of aportable electronic device, specifically a mobile terminal. It will beunderstood, however, that the present invention is not limited to suchembodiments and may be embodied generally in any device that is capableof performing operations in accordance with some embodiments of thepresent invention.

Social networking services (SNSs), for example, online chat rooms,internet forums and bulletin boards, instant messaging and the like,have become increasingly prevalent. SNSs such as these enable peoplehaving similar interests, for example, sports, music, babies, politicsand the like, to rendezvous in virtual communities. Typically, a usercreates the virtual community, for example, an online chat room orbulletin board, and defines the context of the virtual community, forexample, rock music. Virtual communities may also be set up to discussongoing events, for example, concerts, television, shows, sportingevents and the like. In particular, a user can set up an online chatroom to discuss an ongoing football game, or create an online forumwhere people can comment on a beauty contest currently being shown ontelevision. Thus, the emergence of virtual communities may allow usersto communicate with others having like interests without leaving thecomfort of their home, office or the like.

Conventional SNSs typically require someone to take the initiative tocreate the virtual community associated with a particular topic andothers, who may be interested in this topic (potential participants forthe virtual community) need to discover or become aware of the virtualcommunity. Thus, if the creator of the virtual community would like todiscuss an ongoing event with a limited time window, for example, aconcert or a television show, potential participants may not be aware ofthe created virtual community until after the event is over, obviatingthe need for the virtual community associated with the event altogether.

Accordingly, some embodiments of the present invention provide methods,devices, systems and computer program products for automaticallycreating SNSs. In particular, a virtual community associated with sometype of audio/visual broadcast/event having a limited time window may becreated automatically for users consuming the same audio/visual contentsimultaneously as will be discussed in detail below. Thus, someembodiments of the present invention may allow users to participate inthe virtual community about an event having a limited time window beforethe event terminates.

Some embodiments of the present invention will now be discussed withrespect to FIGS. 1 through 5. Referring first to FIG. 1, someembodiments of the present invention provide a network 100 including anSNS server 110 and multiple devices configured to communicate therewith.As illustrated in FIG. 1, the devices in the network 100 configured tocommunicate with the sever 10 include a personal computer 130, atelevision 150, a DVR/TIVO 160, a laptop 170, which is associated with acamera 120, and a portable electronic device 190. The camera 120 may bewithin the laptop 170 or separate from the laptop 170 without departingfrom the scope of the present invention. The devices 130, 150, 160, 170and 190 can communicate with the server over a wire line or wirelesslywithout departing from the scope of the present invention. Althoughembodiments of the present invention illustrated in FIG. 1 include apersonal computer 130, a television 150, a DVR/TIVO 160, a laptop 170and a portable electronic device 190 all of which communicate with theserver 110, embodiments of the present invention are not limited to thisconfiguration. Any device having the capability to participate in SNSsessions and record audio and/or video and provide the recorded audioand/or video to the server 110 is within the scope of the presentinvention. Furthermore, although the devices in FIG. 1 are illustratedas being coupled to the server, the devices may also be coupled to oneor more of the other devices without departing from the scope of thepresent invention.

As used herein, the term “portable electronic device” includes: acellular radiotelephone with or without a multi-line display; a PersonalCommunications System (PCS) terminal that combines a cellularradiotelephone with data processing, facsimile and data communicationscapabilities; a Personal Data Assistant (PDA) that includes aradiotelephone, pager, Internet/intranet access, Web browser, organizer,calendar and/or a global positioning system (GPS) receiver; a gamingdevice, an audio video player, and a conventional laptop and/or palmtopportable computer that includes a radiotelephone transceiver. Anyportable electronic device capable of operating in accordance with someembodiments of the present invention may be used without departing fromthe scope of the present invention.

As further illustrated in FIG. 1, the server 110 includes one or moreSNS sessions SNS 1 115 and SNS 2 117. Although the server 110 isillustrated as running two SNS sessions, the server may run one or morethan two sessions without departing from the scope of the presentinvention. Furthermore, although only a single server 110 is illustratedin FIG. 1, embodiments of the present invention may include two or moreservers 110 without departing from the scope of the present invention.

Operations according to some embodiments of the present invention willbe discussed with respect to the system 100 of FIG. 1. In particular, afirst device, for example, portable electronic device 190, generates afirst audio and/or video fingerprint of an audio and/or video event, forexample, a radio program the user of the first device is interested inand wants to chat with people who listen to the radio program. Thegenerated first audio and/or video fingerprint has a first predeterminedlength (T), which may be about 60 seconds in some embodiments of thepresent invention. The first device 190 transmits the first audio and/orvideo fingerprint to the server 110. In some embodiments of the presentinvention, after transmitting the first audio and/or video fingerprintto the server 110 initially, the first device 190 periodically transmitsa second audio and/or video fingerprint having a second predeterminedlength (t), smaller than the first predetermined length (T), which maybe about 5 seconds or long enough to secure identification. The secondaudio and/or video fingerprint includes different data associated withthe audio and/or video event that is later in time than data included inthe first audio and/or video fingerprint.

In particular, the periodic transmission of the audio and/or videofingerprints of length (t) contain different data than the initialtransmission (length T). The fingerprints reflect live capture ofaudio/video associated with the event and change over time. Transmissionof a smaller fingerprint of length (t) may preserve power. The firstdevice 190 transmits the second audio and/or video fingerprint with aperiodicity equal to the first predetermined length (T), which will bediscussed further below with respect to FIG. 3.

The server 110 receives the first or second audio and/or videofingerprint from the first device 190. The server 110 is configured tocompare the first or second audio and/or video fingerprint to otheraudio and/or video fingerprints received from other devices, forexample, devices 130, 150 and 170 of FIG. 1. If the server 110determines that one of the other audio and/or video fingerprintsreceived at the server 110 includes a portion of the first or the secondaudio and/or video fingerprint, the server 110 automatically creates anSNS session and joins the first device and the other device(s) thereto.

Thus as discussed above, some embodiments of the present invention maymake it possible to, as opposed to conventional solutions, automaticallycreate SNS sessions, for example, chat rooms and forums, for users thatconsume the same audio and/or video content simultaneously. In someembodiments of the present invention, users may be able to participatein the SNS session with only a single click, which may possibly increasethe use of such services.

The example discussed above includes a radio program as the audio and/orvideo event. However, embodiments of the present invention are notlimited to this configuration. The event can be any type of broadcasted,or synchronously streamed, audio/visual content without departing fromthe scope of the present invention. Examples include, but are notlimited to, radio programs broadcasted over the air or the Internet, orTV programs broadcasted over DVB-H or the Internet.

Furthermore, some embodiments of the present invention may provide usersthe ability to pick up the same audio/visual content by means providedby input devices, such as a microphone or a camera built into, orconnected to, a portable electronic device as illustrated in FIG. 2,which will be discussed further below. Thus, embodiments of the presentinvention may also be used in situations like live concerts and sportingevents without departing from the scope of the present invention.

As discussed above, embodiments of the present invention use audio/videorecognition technology (audio/video fingerprinting) to identify usersthat want to participate in a SNS session pertaining to a certain event,for example, the radio program discussed above. Audio fingerprinting isknown to those having skill in the art and can be used for both staticmedia files, such as MP3-files, and real time broadcasts, such as tocollect royalties. Accordingly, details of audio/video fingerprintingare not discussed in herein in the interest of brevity.

Referring now to FIG. 2, details with respect to some embodimentsdevices capable of communicating with a server in accordance with someembodiments of the present invention will be discussed. Specifically,portable electronic device 190 of FIG. 1 will be discussed with respectto the mobile terminal of FIG. 2. It will be understood that thediscussion of the mobile terminal of FIG. 2 is provided for exemplarypurposes only and, therefore, embodiments of the present invention arenot limited to this configuration.

As illustrated in FIG. 2, the portable electronic device 290 includes aportable housing 200 and may include a display 214, a man machineinterface (MMI) 216, a speaker/microphone 217, a web browser 218, atransceiver 212 and a memory 280, any of which may communicate with aprocessor 295. Furthermore, portable electronic devices 290 according toembodiments of the present invention may further include an SNS circuit250, a camera/video recorder 219 and a sound recording device 213according to some embodiments of the present invention, which alsocommunicates with the processor 295. The processor 295 can be anycommercially available or custom microprocessor.

As further illustrated in FIG. 2, the portable electronic device 290communicates with a base station transceiver 260 connected to a mobileswitching center (“MSC”) 270 in accordance with some embodiments of thepresent invention. The transceiver 212 typically includes a transmittercircuit and a receiver circuit, which respectively transmit outgoingradio frequency signals to the base station transceiver 260 and receiveincoming radio frequency signals, such as voice and data signals, fromthe base station transceiver 260 via an antenna 205. The antenna 205 maybe an embedded antenna, a retractable antenna or any antenna known tothose having skill in the art without departing from the scope of thepresent invention. The radio frequency signals transmitted between theportable electronic device 290 and the base station transceiver 260 mayinclude both traffic and control signals (e.g., paging signals/messagesfor incoming calls), which are used to establish and maintaincommunication with another party or destination. The processor 295 maysupport various functions of the portable electronic device, including aSNS Circuit 250 configured to obtain the audio and/or video fingerprintof the event and provide the same to the server (110 FIG. 1) asdiscussed above according to some embodiments of the present inventionas will be discussed further herein.

It will be understood that in some embodiments of the present invention,the transceiver 212 may be a short range transceiver. The short rangetransceiver may be, for example, a Bluetooth transceiver, which mayallow for high transfer rates of data over relatively short distances.It will be further understood that portable electronic devices 290according to some embodiments of the present invention may include awireless transceiver and a short range transceiver/transmitter.

In some embodiments of the present invention, the base stationtransceiver 260 includes the radio transceiver(s) that defines anindividual cell in a cellular network and communicates with the portableelectronic device 290 and other portable electronic devices in the cellusing a radio-link protocol. Although only a single base stationtransceiver 260 is shown, it will be understood that many base stationtransceivers may be connected through, for example, a mobile switchingcenter 270 and other devices to define a wireless communicationsnetwork.

Although the present invention may be embodied in communication devicesor systems, such as the portable electronic device 290, the presentinvention is not limited to such devices and/or systems. Instead, thepresent invention may be embodied in any apparatus that may beconfigured to operate in accordance with some embodiments of the presentinvention.

As further illustrated in FIG. 2, the SNS circuit 250 includes an SNSCreation circuit 251. Although a single circuit is illustrated in FIG.3, it will be understood that this circuit/module can be split intomultiple circuits/modules without departing from the scope of thepresent invention.

In particular, the SNS creation circuit 251 is configured to initiategeneration of a first audio and/or video fingerprint of an audio and/orvideo event. The first audio and/or video fingerprint has a firstpredetermined length (T). The SNS creation circuit 251 is configured tostore the first audio and/or video fingerprint in the memory 280 in thestored recordings 282 or the stored video 284. In particular, the userof the portable electronic device 290 may acquire the audio and/or videoevent using, for example, the microphone 217 and the sound recordingdevice or the camera/video recorder 219. Once the audio and/or videoevent is acquired, the SNS creation circuit 251 may initiate generationof the audio and/or video fingerprint and store the same in memory 280.

The SNS creation circuit 251 may be further configured to initiatetransmission of the first audio and/or video fingerprint to the serveras well as periodic transmissions of a second audio and/or videofingerprint to a server (110 FIG. 1). As discussed above, the secondaudio and/or video fingerprint may have a second predetermined length(t), smaller than the first predetermined length (T) and may includedifferent data associated with the audio and/or video event that islater in time than data included in the first audio and/or videofingerprint. Sending a smaller fingerprint after the initialtransmission may preserve power in the device.

As discussed above, the portable electronic device 290 may be joined tothe SNS session automatically created by the server responsive toreceipt, at the server, of a third audio and/or video fingerprint havingthe first predetermined length (T) from a second device that includes aportion of the first audio and/or video fingerprint or the second audioand/or video fingerprint.

Details in accordance with some embodiments of the present inventionwill now be discussed with respect to FIGS. 1 through 3. A first user(User A of FIG. 3) of a first device may be listening to a radio showhe/she finds interesting and wants to chat with other people who listento the program. The SNS creation circuit 251 of the first device 290initiates generation of an audio fingerprint of length T, for example,60 seconds, using the sound recording device. The audio fingerprint oflength T may be stored in the memory 280 at stored recordings 282. Theaudio fingerprint of length T is sent to the server 110 (number 1 ofFIG. 3) and stored in, for example, SNS 1 115. In order to preservepower, after initial transmission of the audio fingerprint of length T,the SNS creation circuit 251 may initiate sending a second audiofingerprint of length t that is long enough to secure identification,for example, 5 seconds. The second audio fingerprint may includedifferent data than the first audio fingerprint that is later in timethan data included in the first audio fingerprint. The second audiofingerprint may be sent with a periodicity of T after the initialfingerprint is transmitted as illustrated in FIG. 3.

Referring now to process number 2 of FIG. 3, a second user (User B) of asecond device may also want to chat about the same radio program. Thesecond device may also generate a third audio fingerprint of length Tand send the third audio fingerprint to the server 110 as discussed withrespect to the first device 290. The server 110 is configured to comparethe audio fingerprints provided by User A and User B. A comparison oflength t may be sufficient in accordance with some embodiments of thepresent invention. If the server 110 determines that audio fingerprintsmatch, the server 110 automatically creates a chat session and joinsusers A and B to the chat session.

The second device may also be configured to periodically send a fourthaudio fingerprint of length (t), smaller than length (T) of the thirdaudio fingerprint. The fourth audio fingerprint may include differentdata associated with the radio program that is later in time than dataincluded in the third audio fingerprint.

As further illustrated by process number 3 of FIG. 3, at some pointlater in time, a third user (User C) also wants to join the chat sessionassociated with the radio program and generates a fifth audiofingerprint of length T and transmits it to the server 110. As discussedabove, users A and B only periodically send audio fingerprints of length(t), when the server 110 receives the fifth audio fingerprint, theserver 110 waits until another user's fingerprint of length t becomesavailable. This will happen since users A and B send fingerprints oflength t with the periodicity of T.

Referring to process number 4 of FIG. 3, user B's fingerprint of lengtht is sent to the server 110. The server 110 compares the fifth audiofingerprint associated with User C to fourth audio fingerprint sent byuser B and determines that they match. Responsive to the comparisonmatch, user C is joined to the chat session. Users A, B and C are now inthe same chat session.

In some embodiments of the present invention, in order to saveadditional battery power, some of the devices participating the SNSsession may be instructed to stop sending fingerprints as new users areadded to the chat. For example, it would be sufficient if one, such asthe most recently added, device sends fingerprints. However, in theseembodiments, it should also be possible to instruct devicesparticipating in the SNS session to start sending the fingerprints againshould the terminal currently sending the fingerprints terminate the SNSsession.

Furthermore, when audio fingerprints are generated using, for example, amicrophone in a live environment, such as a live concert, it is likelythat the fingerprints will be of poorer quality compared to thosegenerated from traditional broadcast signals. In order to improveperformance in such case, a statistical approach, possibly complementedby fuzzy logic, where fingerprints from multiple devices are comparedmay be used. Furthermore, the signal may also be subject to additionalsignal processing at the time of fingerprint generation, which couldalso improve performance.

It will be understood that actual rendering, and thereby fingerprintgeneration, of a program may be subject to delays of varying degree whentransmitted using different transmission technologies. The delay usuallybecomes evident when digital transmission is used, for example, DVBcompared to traditional analog TV. In order to address this, thefingerprinting matching algorithm in accordance with some embodiments ofthe present invention may allow for some time shifting.

Although the example discussed above refers to a radio program, othertypes of events may also be used. For example, a TV program can also beidentified in the same manner by only producing fingerprints on theaudio part. Furthermore, video fingerprinting may also be used by itselfor in combination with audio fingerprinting without departing from thescope of the present invention.

Referring now to FIGS. 4 and 5, operations according to variousembodiments of the present invention will be discussed. Referring firstto FIG. 4, operations for automatically creating a social networkingservice (SNS) session begin at block 400 by generating at andtransmitting from a first device a first audio and/or video fingerprintof an audio and/or video event. As discussed above, the first audioand/or video fingerprint has a first predetermined length (T), forexample, 60 seconds. For example, an audio and/or video fingerprint of atelevision show may be generated at a first device and the audio and/orvideo fingerprint having the first predetermined length (T) may be sentto a server. The first device may then periodically transmit a secondaudio and/or video fingerprint to a server (block 420). The second audioand/or video fingerprint may have a second predetermined length (t),smaller than the first predetermined length (T), and may includedifferent data associated with the audio and/or video event that islater in time than data included in the first audio and/or videofingerprint. Thus, the later fingerprint transmissions (of length t)contain different data than the initial transmission (length T) for eachdevice. The fingerprints reflect live capture of audio/video and changeover time. The second predetermined length may be just long enough tosecure identification, for example, 5 seconds. The smaller fingerprintmay be sent to conserve power. The first device may join the SNS sessionthat is automatically created by the server responsive to receipt, atthe server, of a third audio and/or video fingerprint having the firstpredetermined length (T) from a second device that includes a portion ofthe first or the second audio and/or video fingerprint (block 440).

Referring now to FIG. 5, operations according to various embodiments ofthe present invention will be discussed. Dotted lines in FIG. 5 depictoptional elements. As illustrated in FIG. 5, operations forautomatically creating a social networking service (SNS) session beginat block 500 by generating at and transmitting from a first device afirst audio and/or video fingerprint of an audio and/or video event. TheSNS session may be, for example, an online chat session, an onlineforum, an online bulletin board, an instant messaging session or thelike.

As discussed above, the first audio and/or video fingerprint having afirst predetermined length (T), for example, 60 seconds. For example, anaudio and/or video fingerprint of a television show may be generated ata first device and the audio and/or video fingerprint having the firstpredetermined length (T) may be sent to a server. The first device maythen periodically transmit a second audio and/or video fingerprint to aserver (block 520). The second audio and/or video fingerprint may have asecond predetermined length (t), smaller than the first predeterminedlength (T), and include different data associated with the audio and/orvideo event that is later in time than data included in the first audioand/or video fingerprint. The second predetermined length may be justlong enough to secure identification, for example, 5 seconds. Thesmaller fingerprint may be sent to conserve power.

In some embodiments of the present invention, the generated audio and/orvideo fingerprint may be processed at the first device to provide animproved first audio and/or video fingerprint of an audio and/or videoevent having the first predetermined length (T).

A second device may generate at and transmit from the device a thirdaudio and/or video fingerprint of an audio and/or video event (block525). The second audio and/or video fingerprint has a firstpredetermined length (T), for example, 60 seconds. A portion of thefirst or the second audio and/or video fingerprint may be compared tothe third audio and/or video fingerprint at the server (530). If it isdetermined that there is a match (block 535), operations proceed toblock 545 where the server automatically creates the SNS session andjoins to first and second device to the SNS session.

If, on the other hand, it is determined that there is no match (block535), operations return to block 520 and repeat until a match isobtained (block 535). It will be understood that operations of block 520can be associated with any of the devices that have been joined in theSNS session. Thus, after transmitting an audio and/or video fingerprinthaving the first predetermined length (T), devices joined to the SNSsession each periodically transmit a smaller audio and/or videofingerprint having the second predetermined length (t) to conserve power(block 520). Thus, the second device may be configured to periodicallytransmit a fourth audio and/or video fingerprint having a length (t) tothe server after initial transmission of the third audio and/or videofingerprint.

In particular, when operations return to block 520 a fifth audio and/orvideo fingerprint having the first predetermined length (T) may bereceived at the server from a third device. The third device may bejoined to the existing SNS session if it is determined that the fifthaudio and/or video fingerprint having the first predetermined length (T)from the third device includes the second, a portion of the third or thefourth audio and/or video fingerprint.

As discussed above, in some embodiments of the present invention fewerthan all of the devices joined to the SNS session may send the periodictransmission of length (t) at block 525. In these embodiments, anindication from the server may be received at the device that is beinginstructed to terminate periodic transmissions to terminate periodictransmission of the audio and/or video fingerprint of length (t). Thisinstruction may be sent from the server responsive to the addition of anew device to the SNS session. In these embodiments, the server may alsobe configured to send an indication to a device that is not sendingperiodic transmissions to reinstate periodically transmitting thegenerated audio and/or video fingerprint of length (t) to the server.The server may send this request responsive to termination of the SNSsession at one of the devices in the SNS session.

In particular, it may be determined at block 550 if a device has beenadded to or deleted from the SNS session. If it is determined that adevice has been added (block 550), the server may send an indication toone or more devices joined to the SNS session to terminate periodictransmission of the audio and/or video fingerprint of length (t) (block555). If, on the other hand, it is determined that a device has beenremoved from the SNS session (block 550), the server may send anindication to one or more devices to reinstate sending the periodictransmissions of the audio and/or video fingerprints of length (t)(block 555).

In some embodiments of the present invention, comparing at block 530includes comparing the first, second, third, fourth and/or fifth audioand/or video fingerprints at the server using statistical methods todetermine if the first, second, third, fourth and/or fifth audio and/orvideo fingerprints are associated with a same audio and/or video event.This comparison (block 530) may including adapting a comparisonalgorithm to allow for time shifting as discussed above with respect toFIG. 3.

In the drawings and specification, there have been disclosed exemplaryembodiments of the invention. However, many variations and modificationscan be made to these embodiments without substantially departing fromthe principles of the present invention. Accordingly, although specificterms are used, they are used in a generic and descriptive sense onlyand not for purposes of limitation, the scope of the invention beingfollowing claims.

1. A method for automatically creating a social networking service (SNS)session, comprising: generating at and transmitting from a first devicea first audio and/or video fingerprint of an audio and/or video event,the first audio and/or video fingerprint having a first predeterminedlength (T); periodically transmitting, from the first device, a secondaudio and/or video fingerprint to a server, the second audio and/orvideo fingerprint having a second predetermined length (t), smaller thanthe first predetermined length (T), and including data associated withthe audio and/or video event that is later in time than data included inthe first audio and/or video fingerprint; and joining the SNS sessionautomatically created by the server responsive to receipt, at theserver, of a third audio and/or video fingerprint having the firstpredetermined length (T) from a second device that includes a portion ofthe first audio and/or video fingerprint or the second audio and/orvideo fingerprint periodically transmitted from the first device.
 2. Themethod of claim 1, wherein the second device is configured to generatethe third audio and/or video fingerprint and periodically transmit afourth audio and/or video fingerprint having the second predeterminedlength (t) to the server, the fourth audio and/or video fingerprintincluding data associated with the audio and/or video event that islater in time than data included in the third audio and/or videofingerprint, the method further comprising: receiving, at the server, afifth audio and/or video fingerprint having the first predeterminedlength (T) from a third device; and joining the third device to the SNSsession if it is determined that the fifth audio and/or videofingerprint having the first predetermined length (T) from the thirddevice includes the second audio and/or video fingerprint, a portion ofthe third audio and/or video fingerprint, or the forth audio and/orvideo fingerprint.
 3. The method of claim 2, further comprising:receiving an indication from the server at the first device or thesecond device to terminate periodic transmission of second or fourthaudio and/or video fingerprint responsive to joining the third device tothe SNS session.
 4. The method of claim 3, further comprising: receivingan indication, from the server, at the first device or the second deviceto reinstate periodically transmitting the second or fourth audio and/orvideo fingerprint to the server responsive to termination of the SNSsession at the third device.
 5. The method of claim 2, furthercomprising: comparing, at the server, the first, second, third, fourthand/or fifth audio and/or video fingerprints using statistical methodsto determine if the first, second third, fourth and/or fifth audioand/or video fingerprints are associated with a same audio and/or videoevent.
 6. The method of claim 5, wherein comparing comprises adapting acomparison algorithm to allow for time shifting.
 7. The method of claim1, wherein generating is followed by processing the generated firstaudio and/or video fingerprint at the first device to provide animproved first audio and/or video fingerprint of an audio and/or videoevent having the first predetermined length (T).
 8. The method of claim1, wherein the SNS session comprises an online chat session, an onlineforum, an online bulletin board or an instant messaging session.
 9. Themethod of claim 1 implemented by a portable electronic device.
 10. Asystem for automatically creating a social networking service session,comprising: first and second devices, the first device being configuredto generate a first audio and/or video fingerprint of an audio and/orvideo event at the first device and transmit the first audio and/orvideo fingerprint, the first audio and/or video fingerprint having afirst predetermined length (T); and a server configured to: receiveperiodic transmissions of a second audio and/or video fingerprint fromthe first device, the second t audio and/or video fingerprint having asecond predetermined length (t), smaller than the first predeterminedlength (T), and including data associated with the audio and/or videoevent that is later in time than data included in the first audio and/orvideo fingerprint; compare a third audio and/or video fingerprint havingthe first predetermined length (T) from the second device to the firstor second audio and/or video fingerprint generated at the first device;automatically create the SNS session if it is determined that the thirdaudio and/or video fingerprint having the first predetermined length (T)from the second device includes a portion of the first audio and/orvideo fingerprint or the second audio and/or video fingerprintperiodically transmitted from the first device; and join the first andsecond devices to the SNS session.
 11. The system of claim 10, whereinthe second device is configured to generate the third audio and/or videofingerprint and periodically transmit a fourth audio and/or videofingerprint having the second predetermined length (t) to the server,the fourth audio and/or video fingerprint including data associated withthe audio and/or video event that is later in time than data included inthe third audio and/or video fingerprint, the system further comprising:a third device configured to generate a fifth audio and/or videofingerprint having the first predetermined length (T), wherein theserver is configured to: receive the fifth audio and/or videofingerprint having the first predetermined length (T) from the thirddevice; and join the third device to the SNS session if it is determinedthat the third audio and/or video fingerprint having the firstpredetermined length (T) from the third device includes the second audioand/or video fingerprint, a portion of the third audio and/or videofingerprint or the fourth audio and/or video fingerprint.
 12. The systemof claim 11, wherein the first device or the second device is furtherconfigured to receive an indication from the server to terminateperiodic transmission of second or fourth audio and/or video fingerprintresponsive to joining the third device to the SNS session
 13. The systemof claim 12, wherein the first device or the second device is furtherconfigured to receive an indication from the server to reinstateperiodically transmitting second or fourth audio and/or videofingerprint to the server responsive to termination of the SNS sessionat the third device.
 14. The system of claim 11, wherein the server isconfigured to compare the first, second, third, fourth and/or fifthaudio and/or video fingerprints using statistical methods to determineif the first, second, third fourth and/or fifth audio and/or videofingerprints are associated with a same audio and/or video event. 15.The system of claim 14, wherein the server is configured to adapt acomparison algorithm to allow for time shifting.
 16. The system of claim10, wherein the first device is further configured to process thegenerated first audio and/or video fingerprint at the first device toprovide an improved first audio and/or video fingerprint of an audioand/or video event having the first predetermined length (T).
 17. Thesystem of claim 10, wherein the SNS session comprises an online chatsession, an online forum, an online bulletin board or an instantmessaging session.
 18. A computer program product for automaticallycreating a social networking service (SNS) session, the computer programproduct comprising: a computer-readable storage medium havingcomputer-readable program code embodied in said medium, saidcomputer-readable program code comprising: computer readable programcode configured to generate at and transmit from a first device a firstaudio and/or video fingerprint of an audio and/or video event, the firstaudio and/or video fingerprint having a first predetermined length (T);computer readable program code configured to periodically transmit, fromthe first device, a second audio and/or video fingerprint to a server,the second audio and/or video fingerprint having a second predeterminedlength (t), smaller than the first predetermined length (T), andincluding data associated with the audio and/or video event that islater in time than data included in the first audio and/or videofingerprint; and computer readable program code configured to join theSNS session automatically created by the server responsive to receipt,at the server, of a third audio and/or video fingerprint having thefirst predetermined length (T) from a second device that includes aportion of the first audio and/or video fingerprint or the second audioand/or video fingerprint periodically transmitted from the first device.19. The computer program product of claim 18, wherein the second deviceis configured to generate the third audio and/or video fingerprint andperiodically transmit a fourth audio and/or video fingerprint having thesecond predetermined length (t) to the server, the fourth audio and/orvideo fingerprint including data associated with the audio and/or videoevent that is later in time than data included in the third audio and/orvideo fingerprint, the compute program product further comprising:computer readable program code configured to receive, at the server, afifth audio and/or video fingerprint having the first predeterminedlength (T) from a third device; and computer readable program codeconfigured to join the third device to the SNS session if it isdetermined that the fifth audio and/or video fingerprint having thefirst predetermined length (T) from the third device includes the secondaudio and/or video fingerprint, a portion of the third audio and/orvideo fingerprint, or the forth audio and/or video fingerprint.
 20. Thecomputer program product of claim 19, further comprising: computerreadable program code configured to receive an indication from theserver at the first device or the second device to terminate periodictransmission of the second or fourth audio and/or video fingerprintresponsive to joining the third device to the SNS session.
 21. Thecomputer program product of claim 20, further comprising: computerreadable program code configured to receive an indication, from theserver at the first device or the second device, to reinstateperiodically transmitting the second or fourth audio and/or videofingerprint to the server responsive to termination of the SNS sessionat the third device.
 22. The computer program product of claim 19,further comprising: computer readable program code configured to compareat the server, the first, second, third, fourth and/or fifth audioand/or video fingerprints using statistical methods to determine if thefirst, second, third, fourth and/or fifth audio and/or videofingerprints are associated with a same audio and/or video event. 23.The computer program product of claim 22, further comprising computerreadable program code configured to adapt a comparison algorithm toallow for time shifting.
 24. The computer program product of claim 19,further comprising processing the generated first audio and/or videofingerprint at the first device to provide an improved first audioand/or video fingerprint of an audio and/or video event having the firstpredetermined length (T).
 25. The computer program product of claim 19,wherein the SNS session comprises an online chat session, an onlineforum, an online bulletin board or an instant messaging session.